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We develop a novel renormalization approach for frustrated quantum antiferromagnets. It is 
designed to consistently treat spin-wave interactions all over the magnetic Brillouin zone, including 
high-energy modes in outer regions as well as low energy modes in the center. Focusing on the 
paradigmatic J1-J2 model, we find a unifying description of the second-order transition between the 
Neel phase and the paramagnetic phase and the first-order transition between the Neel phase and 
the columnar phase. Our approach provides explicit results for the renormalized values of the spin 
stiffness and spin-wave velocity characterizing the low-energy magnons in the Neel phase. 
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Frustrated magnets exhibit quantum phase transitions 
of a rich variety which is subject of intensive current re- 
search Novel scenarios for phase transitions beyond 
the Landau- Ginzburg- Wilson paradigm have been sug- 
gested and joggle fundamental concepts. The Heisen- 
berg model on a square lattice with antiferromagnetic 
couplings Ji and Ji between nearest and next-nearest 
neighbors serves as a prototype for studying magnetic 
quantum-phase transitions (see, e.g., 0] and references 
therein). From the classical limit one expects that two 
different magnetic orders can exist: the Neel phase with 
ordering wave vector (n, it) is favorable for a = J2I J\ < 
1/2 and columnar order with (0,7r) for a > 1/2. 

Quantum fluctuations certainly may induce a para- 
magnetic (PM) phase which is naturally expected near 
awl/2 where both orders compete 4]. Remarkably, 
additonal orders may appear in the Neel phase as well 
as in the PM phase when translation symmetry is bro- 
ken by an additional spin dimerization. The existence of 
such enhanced order crucially depends on the spin value 
S. This becomes most apparent when the spin system 
is represented by a nonlincar-sigma model. Topological 
excitations can give rise to a four-fold ground-state de- 
generacy if S + 1/2 is integer, and a twofold degeneracy 
if S is odd 0, 0. These degeneracies correspond to a 
translation-symmetry breaking by dimerization. 

Field-theoretical approaches have been started from 
various sides, based on the 1/S 7] or the 1/N expan- 
sion 0, 0- The latter approach is able to capture 
some essence of the topological aspects on a mean-field 
level. However, it is the former approach, elaborated to 
a renormalization-group analysis, which predominantly 
has served as basis for a comparison of critical aspects 
between theory and experiment (see e.g. [10(). 

Nevertheless, this approach so far has suffered from two 
intrinsic shortcomings: i) Spin- wave interactions are the 
physical mechanism underlying the renormalization flow. 
On one-loop level, the flow equations describe corrections 
to the physical parameters of relative order 1/S. These 
corrections have been worked out using a continuum ver- 



sion of the nonlinear a model (CNLerM) as a starting 
point 7]. However, for the original lattice model, this 
is not systematic, since corrections of the same order are 
dropped under the mapping of the lattice model onto the 
CNLerM. As a consequence, important effects such as a 
renormalization of the spin-wave velocity are missed, ii) 
Simultaneously, the outer region of the magnetic Bril- 
louin zone (BZ) is only crudely treated. This entails a 
quantitatively significant uncertainty for the prediction 
of the location of the phase boundary. 

In this Letter, we lift these shortcomings by developing 
a renormalization analysis which fully accounts for the 
lattice structure. It combines the systematic treatment 
of all corrections in order 1/ S on the level of the conven- 
tional first-order spin-wave theory (SWT) with the mer- 
its of a renormalization approach, which goes beyond any 
finite order in 1/S by an infinite iteration of differential 
steps, which successively eliminate the spin-wave modes 
of highest energy. As a result, we obtain an improved 
description of the phase transitions. Its only remaining 
drawback is the neglect of topological excitations. From 
a comparison of our results with experimental data one 
may therefore gain deeper insight into the quantitative 
relevance of these excitations. 

To be specific, we stick to the aforementioned J1-J2 
Heisenberg model on a square lattice. We address the 
stability of the Neel phase against quantum fluctuations 
controlled by S and a. Fluctuations are treated in a 
coherent spin state path-integral representation of the 
model, where a spin state corresponds to a unit vector 
fi. In the absence of fluctuations, spins would assume the 
states Iua/b) = | ± ?j) = 15*, ±5) on the two sublattice 
A and B. From the standard Trotter formula emerges an 
imaginary time t (discretized in intevals of duration At) 
and an action of the form Q 

taking n at time r and n' at r — At. For weak quantum 
fluctuations, the componentes of n XiV perpendicular to 
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the magnetization axis are small and may be considered 
as expansion parameters (as in 0). However, attempting 
to directly apply this expansion to the lattice model we 
encountered time ordering difficulties in the action [ll| . 

Instead, we start form a stereographic parametriza- 
tion of coherent states, on sublattice A. \n) = (1 + 
aa/2S)~ s exp(aS- /V^S)\S, 5) where a is the stereo- 
graphic projection of n from the unit sphere onto the 
complex plane, a — tan((9/2) exp(i(f>) with the standard 
spherical angles 9 and <j>. The action can be expressed in 
terns of the stereographic coordinates using the matrix 
elements (l2^ 



(gl&jjf) _ l-aa'/2S (n\S+\n') 
(n\n>) ~ l + aa'/2S 7 (n\n') 



V2S a' 
1 + aa'/2S 



(a is the complex conjugate of a) and analogous expres- 
sions for the coordinate b on sublattice B 13j. 

The explicit expression of the action in terms of a and 
b is too lengthy to be given here. To leading order in 
1/5, the fluctuations are controlled by the bilinear part 
So of the action that represents free magnons. We also 
retain the quartic contribution 5; n t to the action, which 
represents magnon interactions and contain the renor- 
malization of single- magnon parameters of relative order 
1/5. Higher order contributions to the action are ne- 
glected. Terms from the functional Jacobian are also 
negligible on this level. The single-magnon contribution 
to the action can be parameterized in the form 

So = y~] /{^-[a k Aa k - Aa k a k + b k Ab k - Ab k b' w } 

+Ar5[r+(a k a k + 6 k 6 k ) + T k (a k 6 k + a k 6 k )]},(2) 

using the Fourier transform a(r) = J" k e lk r a k , the int- 
geral J k = 2 J p^w over the magnetic BZ |A^;| + \k y \ < tt, 
and the exchange couplings r k = J k — Jq + Jq , r k = 
J k = 2Ji[cos(k x ) + cos(ky)] and J k = 2J2[cos(fc :E -l-fcj ; )-l- 
cos(fca; — k y )]. For simplicity the lattice constant is con- 
sidered as unit length. The dimensionless parameter g 
represents the strength of quantum fluctuations. It as- 
sumes the value g = 1 in the unrenormalized model and 
turns out to increase under renormalization. 

Diagonalizing this bilinear action, one easily obtains 
the magnon energies E k — Sg\T^\^l — 7 k , where 7 k = 
T k /r k . For a < 1/2, the low-energy spin- wave ex- 
citations are characterized by an isotropic dispersion 
E(k) = c|k| + 0(k 2 ) with a spin-wave velocity c = 
V / 8g5Jiv / l — 2a. Likewise, the exchange couplings gen- 
erate a spin stiffness p = S 2 J\(l ~ 2a) for low-energy 
modes. One also obtains the propagators (</> k </> k ) = <?G k 
and (<^ k k ) = (^ k ^k) = g(G k + 1) for fields from the 
same sublattice ((f) — a,b), and (a k 6 k ) = (a k 6 k ) = —gF k 
for fields from different sublattices. In the latter case 
the correlators are unchanged by a replacement <fi — > </>'. 
We have defined G k = (n k + 1/2) (1 - 7^)" 1/2 - 1/2 and 



F k = (n k + l/2)7k(l - 7 2)-V2 where nk = ( e /3B k _ 1)-1 

is the bosonic occupation number. For strong frustration 
(a > 1/2) the stiffness becomes negative and the spin- 
wave velocity is ill defined due to the presence of unstable 
modes in the center of the BZ (see Fig. 0. 

Starting from this action with bilinear and quartic 
terms, we implement a renormalization procedure as fol- 
lows. In successive steps, the modes of highest energy 
(an infinitesimal fraction of all modes) are integrated 
out. This decimation of modes yields an effective the- 
ory for the remaining modes and gives rise to differ- 
ential flow equations. As flow parameter we choose 
I = o 1h(j4bz/^rbz)! where Abz = 2tt 2 is the area of 
the original BZ, and Arbz is the area of the residual 
BZ (RBZ) populated by the remaining modes. On large 
length scales in the Neel phase, the RBZ becomes cir- 
cular and / is the usual logarithmic length scale. The 
evolution of the RBZ and the single-magnon dispersion 
is illustrated in Fig. for various parameters. 
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FIG. 1: Evolution of modes under coarse graining. Each 
panel corresponds to the 

I < 7r > \ky\ < 7T. Red color 
represents small, yellow high posivite energy. Black lines are 
lines of constant energy, blue areas represent unstable modes. 
Panels (a)-(d): In the Neel phase the RBZ may become dis- 
connected first, then always shrinks to a sphere (here S = 1/2, 
a = 0.3, I = 0,0.25,0.5,1.0). Panels (e)-(h): In the Neel 
phase for strong frustation a > 1/2, initially unstable modes 
(blue area) are renormalized to stabel modes and the RBZ 
eventually also shrinks to a sphere (here S = 1/2, a = 0.55, 
I = 0, 0.11, 0.29, 1.30). Panels (i)-(k): In the columnar phase, 
after the elimination of all stable modes, an area of unstable 
modes survives (here S = 2, a = 0.6, I = 0, 0.10, 0.20). 



To one-loop order, corresponding to a systematical cal- 
culation of corrections in order 1/5, the renormalization 
effects due to spin-wave interactions can be captured by 
a flow of the single-magnon parameters. The resulting 
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flow equations are given by 



d^ 1 
dJi 
dJ 2 



§J 2 (dG+ 



2dG°), 
2dG°), 



(3a) 
(3b) 
(3c) 



param. 



where the integrals over the differential fraction d of 
modes of highest energy are defined as dG° = J a G q , 

dG+ = tf( J+/4)G^ and dF" - f^/Jo)^- 

Since the BZ does not remain self-similar under mode 
decimation, we omit the usual rescaling of length and 
time which is necessary only for the identification of 
fixed points under a renormalization-group flow. How- 
ever, dropping this rescaling does not lead to a loss of 
information. Then, a fixed point represents an antifer- 
romagnetically ordered phase. The quantum-disordered 
phase and the transition into it show up as run-away flow. 

Because of the changing geometry of the RBZ and the 
incorporation of the full single-magnon dispersion in our 
renormalization approach, the flow equations can be in- 
tegrated up only numerically. Here, we focus on T = 0, 
although the flow equations are valid also for T > 0. 
The flow of parameters is characterized by the follow- 
ing tendencies. Both exchange couplings J1.2 as well as 
1/g always shrink. These fundamental parameters flow 
in such a way that a always decreases, c 2 increases (ini- 
tially it is negative for a > 1/2), while p may increase 
for small I until it decreases for sufficiently large I. 

The nature of magnetic order can be identified from 
the flow behavior. Three possibilities are observed, (i) 
The RBZ shrinks to a circle of decreasing radius oc e~ l 
[see Fig. n panels (a)-(d) and panels (e)-(h)] while J\,2 
and g (as well as the derived quantities c, p, a) converge 
to positive values. Then Neel order is present, character- 
ized by these renormalized low-energy parameters, (ii) 
At some finite /*, fluctuations become so strong that g 
diverges and vanish. This indicates the loss of mag- 
netic order due to overwhelming quantum fluctuations. 
Close to the transition to the Neel phase, the magnetic 
correlation length - which can be identified with £ = e 
- diverges algebraically like £ ~ (a — a c ) _1 . For 5 = 1/2 
this asymptotic behavior is shown in one inset of Fig. [21 
(iii) For strong frustration, it is also possible that a finite 
RBZ of unstable modes remains after decimation of all 
stable modes (see Fig. Q] panels (i)-(k)). This indicates 
that the instability towards columnar order is effective 
for the renormalized low-energy modes. 

The region of stability of the Neel phase is illustrated 
by the light grey region in Fig. [2 In the absence of frus- 
tration, we find Neel order to be stable for 1/5 < 5.09 in 
remarkable agreement with conventional linear SWT . 
However, this is pure coincidence since in linear SWT 
the phase boundary is determined by the vanishing of 
the local magnetization calculated in order 5°, whereas 
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FIG. 2: Phase diagram showing the 2nd order transition line 
between the Neel ordered and the PM phase (dashed line) 
and the 1st order boundary between the Neel and the colum- 
nar phase (solid line). The border between the PM and the 
columnar phase (dotted line) is just guesswork and cannot be 
calculated within our approach. Insets: Nature of the phase 
transitions. For 5 = 1/2 the renormalized spin stiffness p* 
vanishes and the strength of the quantum fluctuations Z£ di- 
verges at the phase boundary corresponding to a 2nd order 
transition. Close to the the Neel phase the correlation length 
diverges like £ ~ (a — a c ) — l . At the 1st order transition 
(S = 2) p* and Z\ remain finite. 



here it is determined by the divergence of g due to spin- 
wave interactions treated in one-loop order. While the 
phase boundary is located at academicaly small spin val- 
ues for small frustration, 5 reaches physically meaningful 
values at larger frustration where the discrepancies be- 
tween SWT and our renormalization approach become 
more pronounced. In linear SWT, the phase boundary 
smoothly approaches 1/5 \ for a /" 0.5, whereas we 
find the Neel phase to reach up to a = 0.66 for 5 = 0.68. 
For spins smaller than this value, the Neel phase becomes 
unstable towards a PM phase via a second-order transi- 
tion, whereas is becomes unstable towards columnar or- 
der for 5 > 0.68 via a first order transition. 

In the region where the Neel phase reaches up to 
a > 1/2, initially unstable modes are renormalized to 
stable ones by spin-wave interactions. Simultaneously, a 
is renormalized to a value a* < 1/2 and the flow behav- 
ior (i) is realized. In the columnar phase, the flow of a 
saturates at a value a* > 1/2 and the flow behavior (iii) 
is observed. 

Stability of Neel order for a > 0.5 so far has been 
found only by a self consistently modified SW T I14| and 
Schwinger-boson mean-field theory (SBMFT) 0. The 
overall shape of the Neel phase of these approaches is con- 
sistent with our findings. However, in modified SWT and 
SBMFT the first-order transition from Neel to columnar 
order can be obtained only by a comparison of free ener- 
gies between the two phases. In our theory, the transition 
directly emerges from the analysis of spin-wave interac- 
tions in the Neel phase. 
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The nature of the transitions out of the Neel phase 
becomes apparent from the behavior of the fluctuations 
on large length scales (k — > 0), where (0k</>k) — Ty^: 
with Z<j, = ^ 1 9 _ 2a oc j . Approaching the transition into 
the PM phase, the renormalized value Z^ diverges and 
gives rise to a divergent susceptibility (see Fig.[3J). At the 
same time the renormalized p* vanishes while c* remains 
finite. The continuous evolution of Z£ and p* indicate 
the second-order nature of the transition. Approaching 
the transition into the columnar phase, one observes a 
saturation of Z£ and p* at finite values as well as a dis- 
continuous jump of a* indicating a first-order transition. 
Fig. illustrates the dependence of various renormalized 
quantities on a and 1/5 within the Neel phase. The in- 
sets of Fig. 2 show the evolution of p* , Z^ and £ with 
higher resolution at the transitions. 



p'VS- 



' — 1 o 

0.1 02 0.3 0.4 0.5 0.6 0.7 0.1 0.2 0.3 0.4 0.5 0.6 0.7 



C*/(SV8) 




0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.1 0.2 0.3 0.4 0.5 0.6 0.7 

a a 

FIG. 3: Values of the renormalized parameters within the 
Neel phase. Color correponds to the strength of large-scale 
fluctuations (a), the renormalized spin stiffness (b), the frus- 
tration (c), and the spin- wave velocity (d). 

Confidence in the reliability of our findings is provided 
by quantitative comparisons for specific parameter val- 
ues. Results for Z* = c* /c exist from various approaches. 
For 5=1/2 and a = 0, first-order SWT yields a slight 
enhancement of spin-wave velocity, Zf WT = 1.158. We 
find an increased value Z* = 1.20, which is in agreement 
with Monte Carlo (MC) simulations (see 0] and refer- 
ences therein). As 1/5 and/or a increases, the enhance- 
ment factor Z* also increases. At the phase boundary 
1/5 ~ 5.09 for a — 0, the difference is already more 
pronounced: Z C SWT = 1.40 and Z* = 2.04. For a > 0, 
unfortunately, MC data for Z c are not available at the 
transition out of the Neel phase, neither for 5 = 1/2 nor 
for larger physical values of 5. 

In conclusion, we have presented a novel renormal- 
ization aproach for frustrated quantum antiferromagnets 
which fully accounts for the underlying lattice geome- 
try and consistently captures the renormalization of the 



single-magnon parameters by spin-wave interactions all 
over the magnetic BZ. For the J\-Ji model our approach 
yields a unifying description of the second-order transi- 
tion between the Neel phase and the PM phase and the 
first-order transisition between the Neel phase and the 
columnar phase. 

Our approach still falls short of a proper treatment 
of topological aspects, which go far beyond a theory of 
interacting spin waves. However, a comparison of our re- 
sults to data from experiments and simulations will allow 
to deduce more explicitly the quantitative significance of 
the topological terms for the location of the border of 
the Neel phase as well as its renormalized spin- wave pa- 
rameters. Although our one-loop theory is not exact (in 
particular, critical exponents for the transition from the 
Neel to the PM phase are only approximate Q), we ex- 
pect artefacts of the one-loop approximation to be rel- 
evant only for the asymptotic large-scale behavior, but 
less for the values of non-divergent quantities such as Z* 
or the location of the phase boundary. 

For 5 = 1/2, exact diagonalization provides evidence 
for the breakdown of Neel order near a ~ 0.35 ^3] which 
is notably smaller than our value a ss 0.58. This devia- 
tion may be considered as quantitative measure for the 
relevance of topological excitations. It would be desirable 
to have numerical results for 5 = 2, where topological 
excitations do not play a role and agreement with our 
theory should be much better. 

This work was supported by Deutsche Forschungsge- 
meinschaft SFB 608. 
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